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(57) Abstract 

A user interface on a display terminal, such as a personal computer, includes a 3D display region which shows a scene incorporating 
a number of objects, such as items of furniture. A surface finish selector is also displayed and is used to select a surface finish from a 
number of alternatives. In the case of items of furniture, these finishes may correspond to different fabrics for upholstery. A surface texture 
data for a selected finish is automatically downloaded from a remote source and mapped onto the object in the 3D scene. In a preferred 
implementation, the surface finish selector is a frame of a web page and generates control data which is passed to another frame containing 
the 3D scene together with movement controls for changing the viewpoint in the scene. 
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DISPLAY TERMIMAI 

The present invention relates to a display terminal, and in particular to a 
user interface for such a terminal. 
5 According to a first aspect of the present invention, there is provided a 

user interface for a display terminal, the user interface comprising: 

a 3-dimensional display region including one or more displayed objects; 

a surface finish selector arranged to display to the user a plurality of 
alternative surface finishes for the said one or more displayed objects; 

a user input device for selecting one of the plurality of alternative surface 
finishes; va^-^- 

means responsive to the user input device for reading, from a source 
which is remote from the terminal, data for a surface finish selected by the user, 

and cl^T'c*w(:5r^>^_Q_. ^ 

a display generator ^ for m apping the selected surface finish onto the 
displayed object using the said data! ^ 

Preferably the surface finish selector includes a 2-dimensional display of 
samples of the said surface finishes. Preferably the surface finish selector further 
comprises icons representing displayed objects to which the finishes shown in the 

20 samples may be applied. 

The term "3-dimensional (3D) display" as used herein denotes a display 
with properties of perspective and/or parallax. It is not limited in scope to 
stereoscopic displays, such as those generated by a virtual reality headset, but 
includes also displays generated on a conventional 2-dimensional (2D) monitor. 

25 The present invention provides a display terminal designed to facilitate on- 

line access, for example, to the catalogue of a furniture retailer. In real life, a 
furniture retailer may offer, for example, a dozen different sofas, each available in 
a number of different fabrics. Typically, the retailer will have on display in a 
showroom one example of each sofa in one fabric. The display sofa may be 

30 located in a set intended to represent a domestic interior. The customer is then 
shown fabric swatches and has to imagine what the sofa would look like in 
different materials in its intended setting. Just as in real life limitations of space 
prevent a retailer including in a showroom all the different possible permutations of 
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shape and fabric, so also in conventional on-line catalogues, limitations of storage 
space and connection bandwidth have made it impractical to display directly the 
entire range. Hitherto, such on-line catalogues have typically relied upon an 
arrangement analogous to that in the showroom, including, for examples, 
5 photographs of a product in one selected finish, together with details of alternative 
finishes. 

The present invention overcomes these limitations by providing a 3- 
dimensional display of the relevant product, together with a display of sample 
finishes, and then downloading from a r_e mote source jt he data which is needed in 

10 order to map the selected finish onto the product in the 3-dimensional display. 
This allows the user to see directly and realistically any or all of the different 
combinations of product and fabric. This is made possible without unduly heavy 
demands on the storage capacity or bandwidth of the terminal, since typically only 
one selected finish need be downloaded at a time and the amount of data required 

15 to display a 2D sample of a finish is very much less than that required for a 
complete 3D texture map. 

Preferably the user interface further comprises a movement controller for 
moving a viewpoint in the 3D display in response to a user input. 

This preferred feature enables the user to make a more realistic 

20 assessment of a product including the selected finish by viewing it from different 
angles and at different distances. The movement controller may include control 
buttons displayed adjacent the 3D region, or may include a user input device with 
multiple degrees of freedom such as the 3D mouse available commercially as 
"Spacemouse". 

25 Preferably both the surface finish selector and the 3-dimensional display 

region form part of a Web page displayed by a web client running on the said 
display terminal. Preferably in this case each of the surface finish samples 
includes a link to an internet address, or other network address, of the 
corresponding texture file. This preferred approach imports textures into a live 

30 web page over the internet. 

According to a second aspect of the present invention, there is provided a 
display terminal including a user interface in accordance with the first aspect. The 
terminal may be, for example, a personal computer with an internet connection, or 
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may be a dedicated multimedia terminal such as BT's Touchpoint (Trademark) 
kiosk. 

According to a third aspect of the present invention, there is provided a 
method of operating a display terminal comprising: 
5 a) displaying a 3-dimensional environment including one or more objects, 

b) displaying to a user samples of surface finishes which may be applied to 
the one or more objects, 

c) selecting by a user input one of the surface finishes; 

d) retrieving from a source which is remote from the terminal, surface data 
10 corresponding to the selected finish; 

e) mapping the said surface data onto the one or more objects in the 3- 
dimensional environment. 

\ The 3D environment may have been previously downloaded from a remote 

source, or may have been constructed or modified locally, for example using data 
1 5 for the home environment of the user. 

According to a fourth aspect of the present invention, there is provided a 
method of operating a display terminal comprising: 

a) loading and displaying on the terminal a web page including a plurality 
of surface finishes; 

20 b) loading and displaying on the terminal a web page including a 3- 

dimensional environment, which 3-dimensional environment includes one or more 
objects; 

c) in response to selection by the user of one of the plurality of surface 
finishes displayed in step (a), importing surface finish data and mapping the said 
25 data onto one of the said objects displayed in step (b). 

The present invention will now be described in further detail, by way of 
example only, with reference to the accompanying drawings, in which: 

Figure 1 is a diagram showing a network including a display terminal; 
Figure 2 is a diagram showing schematically the display on the terminal of 
30 Figure 1 ; 

Figure 3 is a first example of screen display from a terminal embodying the 
present invention; 
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Figure 4 is a diagram showing a detail of the display on a ternninal 
ennbodying the present invention; 

Figure 5 is a second example of a screen display, showing modifications to 
the display of Figure 3, 

5 

A display terminal comprises a personal computer 1 . The personal 
computer includes a cathode ray tube (CRT) monitor 2 and a mouse 3. In this 
example, the personal computer includes an Intel 166 MHz Pentium MMX 
(Trademark) processor, together with regions of RAM and a hard disk mass storage 
10 device. The persona! computer is connected via modem 4 and the PSTN (public 
switched telephone network) to an Internet Service Provider (ISP). A web 
browser, such as Microsoft Corporation's Internet Explorer (Trademark) runs on the 
processor of the personal computer 1, and in combination with the plug-in 
application described below, is responsible for generating a display on the monitor, 
15 and for interpreting input from the user. Using the web browser, the user 
accesses a web server 6 which, in this example, is maintained by a furniture 
retailer, and includes a product catalogue. The web server 6 then returns to the 
web client on the personal computer 1 a web page which has the format illustrated 
in Figure 2. In this Figure, the different file names are included for ease of 
20 understanding, although normally such file names would not appear explicitly in the 
display. The top level document returned by the server 6 is, in this example, a file 
named BT.htm. This HTML file includes in turn two other web pages. A first web 
page, pinefin5.htm is displayed in a frame on the right hand side of the screen. 
This page includes a 3-dimensional virtual reality display of a domestic interior. 
25 1 In the present example, the 3D interior is generated using a virtual world 

authoring system known as VRT which is available commercially from Superscape 
Ltd. The data generated by VRT is then viewed by the web browser using a plug- 
in application. The plug-in application makes use of a VRML (virtual reality markup 
language) viewer known as Viscape (Trademark), also commercially available from 
30 Superscape Ltd. The plug-in application also establishes a socket connection with 
the web port of the web server. It will be understood however that these 
particular generation and viewing tools are described by way of example only, and 
that other generators/viewers may be used without departing from the scope of 
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the present invention. For example, there are widely available 3D world generation 
tools for the C programming language known as AVRIL, and resulting worlds may 
be viewed with any VRML-1 compliant viewer. As a further alternative, the 
JavaScript language supports 3D modelling. 
5 The data for the 3D world contained in the pinefin5.htm web page is 

returned by the server as an SVR (Superscape Virtual Reality) file, pinefinS.svr. 
The data is stored locally at the terminal The file type is identified by an 
appropriate MIME tag. The web page recognises the file type from the MIME tag 
and passes the data to the Viscape plug-in application. The application generates 

10 and displays, in this example, a 3D view of a domestic interior within a window in 
the frame on the right hand side. Movement control buttons are displayed at the 
bottom of the window. When selected with the mouse, these control buttons 
move the viewpoint for the 3D scene. 

The 3D scene displayed in the right hand side frame includes a number of 

15 products from the catalogue of the retailer. In the present example, these objects 
include an upholstered chair, a carpet and curtains. Each of these objects is 
available in different fabrics. Initially these objects are displayed using a default 
fabric selection for each product. The SVR file includes an object for reading and 
displaying texture information. This object opens a file containing texture data, 

20 saves the data temporarily as a .GIF file on the hard disk of the personal computer 
1, and then maps the texture onto a selected object displayed in the 3D scene, 
using the "Texture" argument of the "LSprite" function defined in the SCL 
language. 

A second web page, Home. htm is displayed in a frame on the left hand 
25 side of the screen. This contains a display of 2D samples or swatches of fabrics 
or materials which are available for the products displayed in the right hand frame. 
A form linked to a search engine may be included, to allow the customer to select 
a fabric sample by name. Alternatively, the user can scroll through all the available 
samples. Marker icons are displayed beside each sample. The marker icons 
30 identify objects in the 3D scene. The top left hand sample in this frame is shown 
as an enlarged detail in Figure 3B. The relevant material is suitable for both 
curtains and for covering the upholstered chair. Accordingly, both a curtain marker 
31 and a chair marker 32 are displayed with the sample. The user can select the 
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fabric to be applied, for example to the chair, by clicking on the chair marker 
beside the fabric sample. The HTML document includes Javascript which detects 
the selection made by the user and sets the relevant marker parameter to a value 
which depends on which fabric was selected. This marker value is returned to the 
5 Viscape application where it is used to address an index of URL's (uniform 
resource locators) corresponding to texture data for different fabrics. A connection 
to the selected URL is then opened and the relevant texture file is downloaded and 
mapped onto the relevant object using the LSprite function, as described 
previously. The display of the 3D scene is immediately updated, so that the chair 

10 is shown finished in the newly selected fabric. This updating occurs automatically, 
without it being necessary to refresh the entire 3D frame. 

It will be understood from the above description, that the HTML page in 
the left hand frame does not merely display fabric samples, but also functions 
actively to control the scene in the right hand frame, depending on input from the 

15 user. 

An additional function performed by the left hand frame is the calculation 
of a total price for a product when covered in a selected fabric. A pricing data file 
includes values for the fabric lengths required for each object in the 3D scene, and 
a price per unit length for each fabric, and a base price for each object. A pricing 

20 function implemented in JavaScript then calculates the total price and displays this 
under the relevant sample, in response to the selection by the user of a relevant 
product cost icon 33, 34 shown underneath the sample. 

After a final selection of finishes for all the objects in the 3D scene, the 
user may store the scene, including the selected surface finish data locally on the 

25 hard disk. The web browser may subsequently be pointed to the URL of another 
retailer or manufacturer. For example the web site of a paintju gnufactu^ r might 
be accessed. A new web page is then loaded into the left hand frame, to show a 
selection of different colour samples in different finishes (matt, gloss, silk etc.). 
These may then be selected by the user for walls or other features of the interior 

30 scene shown in the right hand frame. As described previously, the corresponding 
surface finish data is the imported into the 3D scene, which is modified 
accordingly, so that, for example, the walls are shown covered in the selected 
paint, together with the furniture shown in the fabrics selected at the first web 



wo 98/47106 



7 



PCT/GB98/01022 



site. Again, the left hand frame may include a pricing function to calculate the 
cost of a particular selection by the user, based, in this example, on the cost per 
unit volume of a selected paint, on the coverage required for the selected paint, 
and on the areas to which the paint is applied in the 3D scene. 
5 Figure 3 shows the screen display in the first example described above. A 

frame F1 on the left hand side displays a number of 2D fabric samples s1-s6. The 
frame is bounded by a scroll bar SB. On the right hand side of the screen, a frame 
F2 includes the 3D scene generated by the Viscape plug-in. The displayed objects 
include a curtains 301, chair 302 and carpet 303. Control buttons 305, 306, 307 

10 move the viewpoint in 3 dimensions with respect to the scene, which changes 
correspondingly as the viewpoint moves. 

Figure 4 is a diagram showing an enlarged detail of the left hand frame. 
Figure 5 shows how the screen display is changed after the user has 
clicked on the curtain marker icon beside the sample s3, and has clicked on the 

15 chair marker icon beside sample s6, and the corresponding different surface 
finishes have been mapped onto the curtains and chair in frame F2. 

Although described above in relation to an on-line furniture catalogue, it 
will be understood that the invention is applicable in a wide range of contexts. As 
a further example, manufacturers of high fidelity loudspeakers commonly offer 

20 their products in a wide range of wood veneers or other materials. The display in 
this case might include a 3D scene showing different speakers in a domestic 
setting, and a 2D display of samples of different veneers and materials which, 
when selected by the user, are mapped onto the speakers shown in the 3D scene. 

As well as, or as an alternative to, using the left hand frame for the 

25 selection of surface finishes, it may be used to control the selection of objects for 
insertion in the 3D scene. For example, the user may first generate an empty 3D 
interior based on measurements of a room. Subsequently the user may access the 
on-line catalogue of a furniture retailer and may select objects, such as a chair, 
which are then downloaded and inserted in the 3D scene using the same 

30 mechanism as that adopted for downloading textures in the preceding examples. 

The techniques described above may form part of an on-line trading 
operation, in which, after the selection of certain objects and finishes, the user 
places an order, for example via a form displayed in the left hand frame. 
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Optionally, payment may be made on-line, for example using an encrypted credit 
card number, and the order may be processed automatically at the retailer, for 
example by transferring data identifying the object and finish, and the purchaser's 
address, to a warehouse, or to a manufacturing/assembly operation in the case 
5 where the desired item is not already in stock. 

In a preferred implementation of the system described above, the HTML 
pages initially returned by the web server include product references for the 2D 
samples and for 3D objects. These product references are passed to the plug-in 
application. This application interfaces via a web socket to a CGI (computer 
10 gateway information) script running on the web server. In this way, the 
client/server interface of the plug-in application uses WWW (world wide web) 
protocols to interface via a socket to a CGI script, rather than using a dedicated 
listener. The CGI script returns the data for the 2D fabric samples to be displayed 
on the left hand side of the screen, and 3D data for the objects displayed in the 3D 
15 interior. The user may indicate a choice of, e.g., fabric for an object by dragging 
and dropping the 2D fabric sample onto the relevant object in the 3D interior. The 
plug-in application responds by returning to the server both the identity of the 
selected fabric and the identity of the object in the 3D interior. The server may 
check that the combination of object and fabric is valid before returning the texture 
20 data to the plut-in application. If the combination is not valid, then a message to 
this effect is returned for display on the terminal. Alternatively, the plug-in 
application may submit a request for the return of texture data as soon as the user 
begins to drag the fabric sample towards the 3D interior. This further reduces the 
time taken to respond to the user's selection. When the texture data is returned, 
25 the plug-in application maps the texture data onto the object displayed in the 3D 
interior, in this example, the module of the application which carries out this 
mapping, constitutes in combination with the viewer application, the "display 
generator" of the first aspect of the invention 

A further feature of this implementation is that the display is arranged to 
30 switch between showing the 3D interior just within a frame on one side of the 
window, and showing the 3D interior full-frame. A switch is dispalyed in a footer 
at the bottom of the window. The application detects clicking on this switch by 
the user, and toggles between the two types of view accordingly. 
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9 * 
CLAIMS 

1 . A user interface for a display terminal, the user interface comprising: 

a) a 3-dimensional display region including one or more displayed objects; 
5 b) a surface finish selector arranged to display to the user a plurality of 

alternative surface finishes for the said one or more displayed objects; 

c) a user input device for selecting one of the plurality of alternative 
surface finishes; 

d) means responsive to the user input device for reading, from a source 

— 

10 which is re mote from the terminal, data for a surface finish selected by the user, 
and 

e) a display generator for mapping the selected surface finish onto the 
displayed objecTusmg^he' said" data. 

15 2. A user interface according to claim 1, further comprising a movement 
controller for moving a viewpoint in the 3-dimensional display in response to a user 
input, 

3. A user interface according to claim 1 or 2, in which both the surface finish 
20 selector and the 3-dimensional display region form part of web pages displayed by 

a web client. 

4. A user interface according to any one of the preceding claims, in which 
the surface finish selector includes a 2D display of samples of the said surface 

25 finishes. 

5. A user interface according to claim 4, in which the surface finish selector 
further comprises icons representing displayed objects to which the finishes shown 
in the samples may be applied. 

30 

6. A user interface according to claim 4 or 5, in which each of the surface 
finish samples is associated with a link to a network address of a corresponding 
texture file. 
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7. A user interface according to any one of the preceding claims, in which 
the surface finish selector is a first web page arranged to pass control data to a 
second web page including the 3-dinnensional display region, and the second web 

5 page is arranged to import texture data from a network address determined by the 
said control data, and is arranged to map the said texture data onto a respective 
object in the 3-dimensional display region. 

8. A user interface according to any one of the preceding claims, further 
10 comprising a pricing calculator which is arranged automatically to calculate and 

display the total price of an object displayed the 3-dimensional environment 
depending on the selected finish. 

9. A display terminal incorporating a user interface according to any one of 
15 the preceding claims. 

10. A method of operating a display terminal comprising: 

a) displaying a 3-dimensional environment including one or more objects, 

b) displaying to a user samples of surface finishes which may be applied to 
20 the one or more objects, 

c) selecting by a user input one of the surface finishes; 

d) retrieving from a source which is remote from the terminal, surface data 
corresponding to the selected finish; 

e) mapping the said surface data onto the one or more objects in the 3- 
25 dimensional environment. 

11. A method of operating a display terminal comprising: 

a) loading and displaying on the terminal a web page including a plurality 
of surface finishes; 

30 b) loading and displaying on the terminal a web page including a 3- 

dimensionai environment, which 3-dimensional environment includes one or more 
objects; 
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c) in response to selection by the user of one of the plurality of surface 
finishes displayed in step (a), importing surface finish data and mapping the said 
data onto one of the said objects displayed in step (b). 

5 12. A method according to claim 10 or 1 1 including preliminary steps of: 

i) entering at the display terminal user data defining ' a 3-dimensional 
environment; 

ii) importing from a source remote from the display terminal, data defining 
the said objects; 

10 iii) generating the said 3-dimensional environment for display from the said 

user data and the said data defining the said objects. 

13. A method according to any one of. claims 10 to 12, including steps of 
forming a connection via a communications network to a source of data for 

15 display. 

14. A method according to claim 13, in which the source of data for display 
comprises a trader's on-line catalogue, and the method includes importing samples 
and/or importing the said 3-dimensional environment, or importing parts of the said 

20 3-dimensional environment, from the said on-line catalogue. 

15. A method according to any one of claims 10 to 14, in which the user 
selects a surface finish for an object by dragging a displayed sample surface finish 
onto one of the said objects in the 3-dimensional environment. 

25 

16. A method according to claim 15, including generating a request for 
downloading of surface finish data as soon as the user begins to drag a displayed 
sample finish. 

30 17. A user interface for a display terminal substantially as described with 
respect to the accompanying drawings. 
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